R Notebook

We will compare some classifiers on the “Toxic” column.

Load libraries

library(tidyverse)
source("./parameters.R")

Open the Bag of Word with labels

# We open a relatively small Bag of Words in order to limit calculation time
df = read_csv("bow_words_100_ngrams_1000_rows_balanced_n_2_cut_0.95_tfidf.csv", col_types=col_types_df)
df = df[,-c(2,3,5:9)]
df

Splitting the data

df_train = df[df[1] == 1,-1]
df_test  = df[df[1] == 2,-1]

# Let's control the labels balance
table(df_train$df_toxic)

    0     1 
13934 14042 

table(df_test$df_toxic)

   0    1 
5372 5444